Pre-trained CNNs as Feature-Extraction Modules for Image Captioning
نویسندگان
چکیده
In this work, we present a thorough experimental study about feature extraction using Convolutional NeuralNetworks (CNNs) for the task of image captioning in context deep learning. We perform set 72experiments on 12 classification CNNs pre-trained ImageNet [29] dataset. The features areextracted from last layer after removing fully connected and fed into model. usea unified model with fixed vocabulary size across all experiments to effect changingthe CNN extractor quality. scores are calculated standard metrics inimage captioning. find strong relationship between structure datasetand prove that VGG models give least quality among testedCNNs. end, recommend each evaluation metricswe want optimise, show connection our results previous works. To knowledge, thiswork is most comprehensive comparison extractors
منابع مشابه
Fingerprint Feature Extraction Using CNNs
Feature Extraction is an important step in fingerprint-based recognition systems. In this paper, a CNN Fingerprint Feature Extraction Algorithm is presented. It is applied to thinned fingerprints which have been previously obtained from real gray-scale, noisy fingerprints in the Image-Preprocessing stage, also by using CNNs. Examples are given to demonstrate the functionality of the proposed al...
متن کاملHand Veins Feature Extraction Using Dt-cnns
As the identification process is based on the unique patterns of the users, biometrics technologies are expected to provide highly secure authentication systems. The existing systems using fingerprints or retina patterns are, however, very vulnerable. One’s fingerprints are accessible as soon as the person touches a surface, while a high resolution camera easily captures the retina pattern. Thu...
متن کاملFeature Extraction for Image Mining
Due to the digitization of data and advances in technology, it has become extremely easy to obtain and store large quantities of data, particularly Multimedia data. Fields ranging from Commercial to Military need to analyze these data in an efficient and fast manner. Presently, tools for mining images are few and require human intervention. Feature selection and extraction is the pre-processing...
متن کاملImage Feature Extraction Acceleration
Image feature extraction is instrumental for most of the best-performing algorithms in computer vision. However, it is also expensive in terms of computational and memory resources for embedded systems due to the need of dealing with individual pixels at the earliest processing levels. In this regard, conventional system architectures do not take advantage of potential exploitation of paralleli...
متن کاملUnderstanding trained CNNs by indexing neuron selectivity
The impressive performance and plasticity of convolutional neural networks to solve different vision problems are shadowed by their black-box nature and its consequent lack of full understanding. To reduce this gap we propose to describe the activity of individual neurons by quantifying their inherent selectivity to specific properties. Our approach is based on the definition of feature selecti...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Letters on Computer Vision and Image Analysis
سال: 2022
ISSN: ['1577-5097']
DOI: https://doi.org/10.5565/rev/elcvia.1436